Explainable Artificial Intelligence Research Articles

Predicting skin cancer risk from facial images with an explainable artificial intelligence (XAI) based approach: a proof-of-concept study

Efficient identification of individuals at high risk of skin cancer is crucial for implementing personalized screening strategies and subsequent care. While Artificial Intelligence holds promising potential for predictive analysis using image data, its application for skin cancer risk prediction utilizing facial images remains unexplored. We present a neural network-based explainable artificial intelligence (XAI) approach for skin cancer risk prediction based on 2D facial images and compare its efficacy to 18 established skin cancer risk factors using data from the Rotterdam Study. The study employed data from the Rotterdam population-based study in which both skin cancer risk factors and 2D facial images and the occurrence of skin cancer were collected from 2010 to 2018. We conducted a deep-learning survival analysis based on 2D facial images using our developed XAI approach. We subsequently compared these results with survival analysis based on skin cancer risk factors using cox proportional hazard regression. Among the 2810 participants (mean Age=68.5±9.3 years, average Follow-up=5.0 years), 228 participants were diagnosed with skin cancer after photo acquisition. Our XAI approach achieved superior predictive accuracy based on 2D facial images (c-index=0.72, 95% CI: 0.70-0.74), outperforming that of the known risk factors (c-index=0.59, 95% CI 0.57-0.61). This proof-of-concept study underscores the high potential of harnessing facial images and a tailored XAI approach as an easily accessible alternative over known risk factors for identifying individuals at high risk of skin cancer. The Rotterdam Study is funded through unrestricted research grants from Erasmus Medical Center and Erasmus University, Rotterdam, Netherlands Organization for the Health Research and Development (ZonMw), the Research Institute for Diseases in the Elderly (RIDE), the Ministry of Education, Culture and Science, the Ministry for Health, Welfare and Sports, the European Commission (DG XII), and the Municipality of Rotterdam. G.V. Roshchupkin is supported by the ZonMw Veni grant (Veni, 549 1936320).

Explainable AI and Blockchain for Metaverse: A Security and Privacy Perspective

Explainable AI and Blockchain for Metaverse: A Security and Privacy Perspective

Enhancing corn quality prediction: Variable selection and explainable AI in spectroscopic analysis

This study addresses the challenge of effectively selecting relevant variables and providing interpretable insights in spectroscopic analysis (1100–2498 nm) of corn quality (moisture, fat, protein, and starch), incorporating variable selection techniques and explainable artificial intelligence (AI). Three variable selection algorithms were used to select 36 important variables, and through combinatorial optimization, only 11 common wavelengths were chosen. Partial least squares regression (PLSR) models were developed using the full spectral range, individual variables, and common variables. Based on the root mean square errors of prediction (RMSEP), the PLSR models with common variables outperformed individual feature variables for starch (0.22 % vs. 0.24 %) and were comparable for oil (0.05 % vs. 0.05 %), water (0.02 % vs. 0.01 %) and protein (0.12 % vs. 0.09 %). The SHapley Additive exPlanation (SHAP) method was employed to explain the PLSR model and assess the contribution of common variables. This combined approach significantly improved the accuracy and interpretability of corn prediction models, providing trust in the results and facilitating the understanding of the relationship between spectral features and corn quality attributes.

A Critical Review of Artificial Intelligence Based Approaches in Intrusion Detection: A Comprehensive Analysis

Intrusion detection (ID) is critical in securing computer networks against various malicious attacks. Recent advancements in machine learning (ML), deep learning (DL), federated learning (FL), and explainable artificial intelligence (XAI) have drawn significant attention as potential approaches for ID. DL-based approaches have shown impressive performance in ID by automatically learning relevant features from data but require significant labelled data and computational resources to train complex models. ML-based approaches require fewer computational resources and labelled data, but their ability to generalize to unseen data is limited. FL is a relatively new approach that enables multiple entities to train a model collectively without exchanging their data, providing privacy and security benefits, making it an attractive option for ID. However, FL-based approaches require more communication resources and additional computation to aggregate models from different entities. XAI is critical for understanding how AI models make decisions, improving interpretability and transparency. While existing literature has explored the strengths and weaknesses of DL, ML, FL, and XAI-based approaches for ID, a significant gap exists in providing a comprehensive analysis of the specific use cases and scenarios where each approach is most suitable. This paper seeks to fill this void by delivering an in-depth review that not only highlights strengths and weaknesses but also offers guidance for selecting the appropriate approach based on the unique ID context and available resources. The selection of an appropriate approach depends on the specific use case, and this work provides insights into which method is best suited for various network sizes, data availability, privacy, and security concerns, thus aiding practitioners in making informed decisions for their ID needs.

Review Paper on SignSense : An AI Framework for Sign Language Recognition

In this project, we propose an ensemble learning-based system for Sign Language Recognition (SLR) integrated with an Explainable AI (XAI) component called SignExplainer. Our goal is to enhance transparency and trust in SLR systems by providing interpretable predictions. The ensemble learning architecture is designed to recognize sign gestures from images, and the SignExplainer module generates statistical values to evaluate prediction correctness. Performance evaluation on benchmark datasets like ASL and BSL demonstrates the effectiveness of our approach in interpreting predictions from various machine learning and deep learning models. Future work aims to extend this methodology to real-time applications and other Sign Languages, advancing accessibility and inclusivity for the hearing-impaired community

Explainable AI-driven model for gastrointestinal cancer classification

Although the detection procedure has been shown to be highly effective, there are several obstacles to overcome in the usage of AI-assisted cancer cell detection in clinical settings. These issues stem mostly from the failure to identify the underlying processes. Because AI-assisted diagnosis does not offer a clear decision-making process, doctors are dubious about it. In this instance, the advent of Explainable Artificial Intelligence (XAI), which offers explanations for prediction models, solves the AI black box issue. The SHapley Additive exPlanations (SHAP) approach, which results in the interpretation of model predictions, is the main emphasis of this work. The intermediate layer in this study was a hybrid model made up of three Convolutional Neural Networks (CNNs) (InceptionV3, InceptionResNetV2, and VGG16) that combined their predictions. The KvasirV2 dataset, which comprises pathological symptoms associated to cancer, was used to train the model. Our combined model yielded an accuracy of 93.17% and an F1 score of 97%. After training the combined model, we use SHAP to analyze images from these three groups to provide an explanation of the decision that affects the model prediction.

CACTUS: A Comprehensive Abstraction and Classification Tool for Uncovering Structures

The availability of large datasets is providing the impetus for driving many current artificial intelligent developments. However, specific challenges arise in developing solutions that exploit small datasets, mainly due to practical and cost-effective deployment issues, as well as the opacity of deep learning models. To address this, the Comprehensive Abstraction and Classification Tool for Uncovering Structures (CACTUS) is presented as a means of improving secure analytics by effectively employing explainable artificial intelligence. CACTUS achieves this by providing additional support for categorical attributes, preserving their original meaning, optimising memory usage, and speeding up the computation through parallelisation. It exposes to the user the frequency of the attributes in each class and ranks them by their discriminative power. Performance is assessed by applying it to various domains, including Wisconsin Diagnostic Breast Cancer, Thyroid0387, Mushroom, Cleveland Heart Disease, and Adult Income datasets.

Visual coating inspection framework via self-labeling and multi-stage deep learning strategies

AbstractAn instantaneous and precise coating inspection method is imperative to mitigate the risk of flaws, defects, and discrepancies on coated surfaces. While many studies have demonstrated the effectiveness of automated visual inspection (AVI) approaches enhanced by computer vision and deep learning, critical challenges exist for practical applications in the manufacturing domain. Computer vision has proven to be inflexible, demanding sophisticated algorithms for diverse feature extraction. In deep learning, supervised approaches are constrained by the need for annotated datasets, whereas unsupervised methods often result in lower performance. Addressing these challenges, this paper proposes a novel deep learning-based automated visual inspection (AVI) framework designed to minimize the necessity for extensive feature engineering, programming, and manual data annotation in classifying fuel injection nozzles and discerning their coating interfaces from scratch. This proposed framework comprises six integral components: It begins by distinguishing between coated and uncoated nozzles through gray level co-occurrence matrix (GLCM)-based texture analysis and autoencoder (AE)-based classification. This is followed by cropping surface images from uncoated nozzles, and then building an AE model to estimate the coating interface locations on coated nozzles. The next step involves generating autonomously annotated datasets derived from these estimated coating interface locations. Subsequently, a convolutional neural network (CNN)-based detection model is trained to accurately localize the coating interface locations. The final component focuses on enhancing model performance and trustworthiness. This framework demonstrated over 95% accuracy in pinpointing the coating interfaces within the error range of ± 6 pixels and processed at a rate of 7.18 images per second. Additionally, explainable artificial intelligence (XAI) techniques such as t-distributed stochastic neighbor embedding (t-SNE) and the integrated gradient substantiated the reliability of the models.

An explainable machine learning model for prediction of high-risk nonalcoholic steatohepatitis

Early identification of high-risk metabolic dysfunction-associated steatohepatitis (MASH) can offer patients access to novel therapeutic options and potentially decrease the risk of progression to cirrhosis. This study aimed to develop an explainable machine learning model for high-risk MASH prediction and compare its performance with well-established biomarkers. Data were derived from the National Health and Nutrition Examination Surveys (NHANES) 2017-March 2020, which included a total of 5281 adults with valid elastography measurements. We used a FAST score ≥ 0.35, calculated using liver stiffness measurement and controlled attenuation parameter values and aspartate aminotransferase levels, to identify individuals with high-risk MASH. We developed an ensemble-based machine learning XGBoost model to detect high-risk MASH and explored the model’s interpretability using an explainable artificial intelligence SHAP method. The prevalence of high-risk MASH was 6.9%. Our XGBoost model achieved a high level of sensitivity (0.82), specificity (0.91), accuracy (0.90), and AUC (0.95) for identifying high-risk MASH. Our model demonstrated a superior ability to predict high-risk MASH vs. FIB-4, APRI, BARD, and MASLD fibrosis scores (AUC of 0.95 vs. 0.50, 0.50, 0.49 and 0.50, respectively). To explain the high performance of our model, we found that the top 5 predictors of high-risk MASH were ALT, GGT, platelet count, waist circumference, and age. We used an explainable ML approach to develop a clinically applicable model that outperforms commonly used clinical risk indices and could increase the identification of high-risk MASH patients in resource-limited settings.

Towards Transparent Healthcare: Advancing Local Explanation Methods in Explainable Artificial Intelligence

This paper focuses on the use of local Explainable Artificial Intelligence (XAI) methods, particularly the Local Rule-Based Explanations (LORE) technique, within healthcare and medical settings. It emphasizes the critical role of interpretability and transparency in AI systems for diagnosing diseases, predicting patient outcomes, and creating personalized treatment plans. While acknowledging the complexities and inherent trade-offs between interpretability and model performance, our work underscores the significance of local XAI methods in enhancing decision-making processes in healthcare. By providing granular, case-specific insights, local XAI methods like LORE enhance physicians’ and patients’ understanding of machine learning models and their outcome. Our paper reviews significant contributions to local XAI in healthcare, highlighting its potential to improve clinical decision making, ensure fairness, and comply with regulatory standards.

Detection of sickle cell disease using deep neural networks and explainable artificial intelligence

Abstract Sickle cell disease (SCD), a blood disorder that transforms the shape of red blood cells into a distinctive sickle form, is a major concern as it not only compromises the blood’s oxygen-carrying capacity but also poses significant health risks, ranging from weakness to paralysis and, in severe cases, even fatality. This condition not only underscores the pressing need for innovative solutions but also encapsulates the broader challenges faced by medical professionals, including delayed treatment, protracted processes, and the potential for subjective errors in diagnosis and classification. Consequently, the application of artificial intelligence (AI) in healthcare has emerged as a transformative force, inspiring multidisciplinary efforts to overcome the complexities associated with SCD and enhance diagnostic accuracy and treatment outcomes. The use of transfer learning helps to extract features from the input dataset and give an accurate prediction. We analyse and compare the performance parameters of three distinct models for this purpose: GoogLeNet, ResNet18, and ResNet50. The best results were shown by the ResNet50 model, with an accuracy of 94.90%. Explainable AI is the best approach for transparency and confirmation of the predictions made by the classifiers. This research utilizes Grad-CAM to interpret and make the models more reliable. Therefore, this specific approach benefits pathologists through its speed, precision, and accuracy of classification of sickle cells.

AI guided workflows for efficiently screening the materials space

Artificial intelligence (AI) may capture the properties and functions of materials better than previous theoretical/computational methods because it targets correlations and does not assume a single, specific underlying physical model. Therefore, it addresses the full intricacy of the numerous processes that govern the function of materials. However, the statistical analysis and interpretation of AI models require careful attention. The review article started with a brief discussion of historical aspects of data-centric science. It then focused on the recently developed, explainable AI methods [8,10] and applications [2,11,12]. The identified "rules" determine the properties and functions of materials. The rules depend on descriptive parameters called "materials genes." As genes in biology, they are correlated with a certain material property or function. Thus, these materials genes help to identify materials that are, for example, better electrical conductors or better heat insulators or better catalysts.

Predictive modeling for breast cancer classification in the context of Bangladeshi patients by use of machine learning approach with explainable AI

Breast cancer has rapidly increased in prevalence in recent years, making it one of the leading causes of mortality worldwide. Among all cancers, it is by far the most common. Diagnosing this illness manually requires significant time and expertise. Since detecting breast cancer is a time-consuming process, preventing its further spread can be aided by creating machine-based forecasts. Machine learning and Explainable AI are crucial in classification as they not only provide accurate predictions but also offer insights into how the model arrives at its decisions, aiding in the understanding and trustworthiness of the classification results. In this study, we evaluate and compare the classification accuracy, precision, recall, and F1 scores of five different machine learning methods using a primary dataset (500 patients from Dhaka Medical College Hospital). Five different supervised machine learning techniques, including decision tree, random forest, logistic regression, naive bayes, and XGBoost, have been used to achieve optimal results on our dataset. Additionally, this study applied SHAP analysis to the XGBoost model to interpret the model’s predictions and understand the impact of each feature on the model’s output. We compared the accuracy with which several algorithms classified the data, as well as contrasted with other literature in this field. After final evaluation, this study found that XGBoost achieved the best model accuracy, which is 97%.

Using explainable artificial intelligence (XAI) methods to understand the nonlinear relationship between the Three Gorges Dam and downstream flood

Study RegionIn the Yangtze River basin of China. Study focusThe emerging Explainable Artificial Intelligence (XAI) methods provide us an opportunity to understand the nonlinear relationship that the Deep Learning(DL) model learned inside. The construction of the Three Gorges Dam (TGD) has successfully minimized the likelihood of flooding in the Yangtze River basin. The XAI methods can help us to know the nonlinear relationship behind it. We apply the Long Short Term Memory (LSTM) network, in conjunction with two XAI methods, SHapley Additive exPlanation (SHAP) and Expected Gradient (EG), to do our work.In our DL model, we use YiChang (YC) station runoff,Precipitation (Pre) and vapour pressure deficit (VPD) data from the middle and lower river basin as input, while the output of the model generates runoff data at the DaTong (DT) station, XAI methods enable us to calculate the significance of each input feature is for generating the output feature in a DL model. In this study, we examine the difference in importance scores between the Before Three Gorges Dam (BTGD) period and the After Three Gorges Dam (ATGD) period. New Hydrological Insights for the RegionIn the BTGD period, YC runoff was the primary contributor to flooding at the DT station. However, in the ATGD period, the largest contribution to flooding in the middle and lower Yangtze River basin has shifted from YC runoff to the the middle and lower reaches of precipitation. Our results suggest that the XAI can show the nonlinear relationship between the TGD and downstream flood clearly and the TGD can effectively mitigate flooding in the middle and lower river basins by regulating runoff from the upper river basin. The work shows the potential of XAI to explain the nonlinear relationship in the hydrology field.

Using explainable AI to investigate electrocardiogram changes during healthy aging-From expert features to raw signals.

Cardiovascular diseases remain the leading global cause of mortality. Age is an important covariate whose effect is most easily investigated in a healthy cohort to properly distinguish the former from disease-related changes. Traditionally, most of such insights have been drawn from the analysis of electrocardiogram (ECG) feature changes in individuals as they age. However, these features, while informative, may potentially obscure underlying data relationships. In this paper we present the following contributions: (1) We employ a deep-learning model and a tree-based model to analyze ECG data from a robust dataset of healthy individuals across varying ages in both raw signals and ECG feature format. (2) We use explainable AI methods to identify the most discriminative ECG features across age groups.(3) Our analysis with tree-based classifiers reveals age-related declines in inferred breathing rates and identifies notably high SDANN values as indicative of elderly individuals, distinguishing them from younger adults. (4) Furthermore, the deep-learning model underscores the pivotal role of the P-wave in age predictions across all age groups, suggesting potential changes in the distribution of different P-wave types with age. These findings shed new light on age-related ECG changes, offering insights that transcend traditional feature-based approaches.

An eXplainable Artificial Intelligence Methodology on Big Data Architecture

AbstractAlthough artificial intelligence has become part of everyone’s real life, a trust crisis against such systems is occurring, thus increasing the need to explain black-box predictions, especially in the military, medical, and financial domains. Modern eXplainable Artificial Intelligence (XAI) techniques focus on benchmark datasets, but the cognitive applicability of such solutions under big data settings is still unclear due to memory or computation constraints. In this paper, we extend a model-agnostic XAI methodology, named Cluster-Aided Space Transformation for Local Explanation (CASTLE), to be able to deal with high-volume datasets. CASTLE aims to explain the black-box behavior of predictive models by combining both local (i.e., based on the input sample) and global (i.e., based on the whole scope for action of the model) information. In particular, the local explanation provides a rule-based explanation for the prediction of a target instance as well as the directions to update the likelihood of the predicted class. Our extension leverages modern big data technologies (e.g., Apache Spark) to handle the high volume, variety, and velocity of huge datasets. We have evaluated the framework on five datasets, in terms of temporal efficiency, explanation quality, and model significance. Our results indicate that the proposed approach retains the high-quality explanations associated with CASTLE while efficiently handling large datasets. Importantly, it exhibits a sub-linear, rather than exponential, dependence on dataset size, making it a scalable solution for massive datasets or in any big data scenario.

Explainable Automatic Detection of Fiber–Cement Roofs in Aerial RGB Images

Following European directives, asbestos–cement corrugated roofing tiles must be eliminated by 2025. Therefore, identifying asbestos–cement rooftops is the first necessary step to proceed with their removal. Unfortunately, asbestos detection is a challenging task. Current procedures for identifying asbestos require human exploration, which is costly and slow. This has motivated the interest of governments and companies in developing automatic tools that can help to detect and classify these types of materials that are dangerous to the population. This paper explores multiple computer vision techniques based on Deep Learning to advance the automatic detection of asbestos in aerial images. On the one hand, we trained and tested two classification architectures, obtaining high accuracy levels. On the other, we implemented an explainable AI method to discern what information in an RGB image is relevant for a successful classification, ensuring that our classifiers’ learning process is guided by the right variables—color, surface patterns, texture, etc.—observable on asbestos rooftops.

Explainable Artificial Intelligence based Detection and Early Diagnosis of Polycystic Ovaries Syndrome using Optimized Hybrid Deep Learning Technique

Customer satisfaction is directly related with the customer retention. The marketer should understand the needs and expectations of his customers for making an effective marketing strategy. Measurement of customer satisfaction enables the firm to deliver maximum value to the customer. Delivering the values to customers facilitates in the creation of loyal customers. The main thrust area among these challenges is the dissatisfaction of customers. The main reason behind this dissatisfaction is the expectations of modern customers who are tech-savvy guys. The digitalization in the area of business is likely to continue in future which will create more challenges before the marketers. Hence customer satisfaction cannot be ignored in the modern digital age

Enhancing Financial Sentiment Analysis: A Deep Dive into Natural Language Processing for Market Prediction Industries

The purpose of this study is to investigate the enhancement of Financial Sentiment Analysis by conducting an in-depth investigation of Natural Language Processing (NLP) approaches for the purpose of improving market prediction. The purpose of this research is to investigate the potential of natural language processing (NLP) to improve the accuracy and efficiency of sentiment analysis. This is in response to the complex structure of financial markets and the crucial role that sentiment plays. The examination of the relevant literature highlights the limits of traditional methods and the urgent need for creative solutions in the field of financial sentiment research. The approach that we use entails the careful collecting of data from social media and financial news, with a particular emphasis on the utilization of strong pre-processing tools. The research assesses the performance parameters of accuracy, precision, recall, and correlation with market trends by using natural language processing (NLP) technologies such as algorithms for sentiment analysis, Named Entity Recognition, and deep learning models. The findings include a comparative examination of conventional methods and those based on natural language processing (NLP), therefore revealing insights into the significant influence that sentiment has on market patterns. The results not only provide a contribution to the theoretical knowledge of sentiment research, but they also offer real consequences for financial analysts who are looking to make market forecasts that are more accurate and timelier. The research suggests ways for refinement, with an emphasis on enhanced pre-processing and Explainable AI integration. These tactics are being proposed to address issues in data quality and bias. When looking to the future, the study provides an overview of potential future paths, which include the investigation of external influences and the development of deep learning models for accurate market forecasting respectively. To summaries, the findings of this research establish natural language processing (NLP) as a revolutionary force in the process of redefining financial sentiment analysis. Furthermore, it offers a path for future developments in the ever-changing world of market prediction.

Going Beyond XAI: A Systematic Survey for Explanation-Guided Learning

As the societal impact of Deep Neural Networks (DNNs) grows, the goals for advancing DNNs become more complex and diverse, ranging from improving a conventional model accuracy metric to infusing advanced human virtues such as fairness, accountability, transparency, and unbiasedness. Recently, techniques in Explainable Artificial Intelligence (XAI) have been attracting considerable attention and have tremendously helped Machine Learning (ML) engineers in understand AI models. However, at the same time, we started to witness the emerging need beyond XAI among AI communities; based on the insights learned from XAI, how can we better empower ML engineers in steering their DNNs so that the model’s reasonableness and performance can be improved as intended? This article provides a timely and extensive literature overview of the field Explanation-Guided Learning (EGL), a domain of techniques that steer the DNNs’ reasoning process by adding regularization, supervision, or intervention on model explanations. In doing so, we first provide a formal definition of EGL and its general learning paradigm. Second, an overview of the key factors for EGL evaluation, as well as summarization and categorization of existing evaluation procedures and metrics for EGL are provided. Finally, the current and potential future application areas and directions of EGL are discussed, and an extensive experimental study is presented aiming at providing comprehensive comparative studies among existing EGL models in various popular application domains, such as Computer Vision and Natural Language Processing domains. Additional resources related to event prediction are included in the article website: https://kugaoyang.github.io/EGL/